ON THE PROXIMINALITY OF RIDGE FUNCTIONS 
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Abstract. Using two results of Garkavi, Medvedev and Khavinson [7], we 
give sufficient conditions for proximinality of sums of two ridge functions with 
bounded and continuous summands in the spaces of bounded and continuous 
multivariate functions respectively. In the first case, we give an example which 
shows that the corresponding sufficient condition cannot be made weaker for 
some subsets of R". In the second case, we obtain also a necessary condition 
for proximinality. All the results are furnished with plenty of examples. The 
results, examples and following discussions naturally lead us to a conjecture on 
the proximinality of the considered class of ridge functions. The main purpose 
of the paper is to draw readers' attention to this conjecture. 



0. Introduction 

In multivariate approximation theory, special functions called ridge functions are 
widely used. A ridge function is a multivariate function of the form g (a • x), where 
g is a univariate function, a = (ai, a n ) is a vector (direction) different from zero, 
x = (x%, x n ) is the variable and a-x is the inner product. In other words, a ridge 
function is a composition of a univariate function with a linear functional over R™. 
These functions arise naturally in various fields. They arise in partial differential 
equations (where they are called plane waves [15]), in computerized tomography 
(see, e.g., [19,22]; the name ridge function was coined by Logan and Shepp[19] in 
one of the seminal papers on tomography) , in statistics (especially, in the theory of 
projection pursuit and projection regression; see, e.g., [4,11]). Ridge functions are 
also the underpinnings of many central models in neural networks which has become 
increasing more popular in computer science, statistics, engineering, physics, etc. 
(see [24] and references therein). We refer the reader to Pinkus [23] for various 
motivations for the study of ridge functions and ridge function approximation. 

Let E be a normed linear space and F be its subspace. We say that F is 
proximinal in E if for any element e E E there exists at least one element /q E F 
such that 

||e-/ ||= inf ||e-/||. 
/ tJ* 

In this case, the element /o is said to be extremal to e. 

Although at present there are a great deal of interesting papers devoted to the 
approximation by ridge functions (see, e.g., [2,3,5,9,12,13,17,18,20,24,25]), some 
problems of this approximation have not been solved completely yet. In the follow- 
ing, we are going to deal with one of such problems, namely with the problem of 
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proximinality of the set of linear combinations of ridge functions in the spaces of 
bounded and continuous functions respectively. This problem will be considered in 
the simplest case when the class of approximating functions is the set 

11 = TZ (a 1 , a 2 ) = { 9l (a 1 *) + g 2 (a 2 -x) : g. : R -► R, i = 1, 2}. 

Here a 1 and a 2 are fixed directions and we vary over gi. It is clear that this is a 
linear space. Consider the following three subspaces of 1Z. The first is obtained 
by taking only bounded sums g\ (a*-x) + g 2 (a 2, x) over some set X in R™. We 
denote this subspace by lZ a (X). The second and the third are subspaces of 1Z with 
bounded and continuous summands gi (a 1 • x) , i = 1,2, on X respectively. These 
subspaces will be denoted by IZb(X) and 1Z C (X). In the case of 1Z C (X), the set X 
is considered to be compact. 

Let B(X) and C(X) be the spaces of bounded and continuous multivariate 
functions over X respectively. What conditions must one impose on X in order that 
the sets lZ a (X) and IZb(X) be proximinal in B(X) and the set 1Z C (X) be proximinal 
in C(X)1 We are also interested in necessary conditions for proximinality. It follows 
from one result of Garkavi, Medvedev and Khavinson (see theoreml [7]) that lZ a (X) 
is proximinal in B(X) for all subsets X of R™. There is also an answer (see theorem 
2 [7]) for proximinality of IZb(X) in B{X). This will be discussed in Section 1. Is 
the set IZb(X) always proximinal in B{X)1 There is an an example of a set X C R™ 
and a bounded function / on X for which there does not exist an extremal element 
in K b (X). 

In Section 2, we will obtain sufficient conditions for the existence of extremal 
elements from 1Z C (X) to an arbitrary function / G C(X). Based on one result of 
Marshall and O'Farrell [21], we will also give a necessary condition for proximinality 
of 1Z C (X) in C(X). All the theorems, following discussions and examples of the 
paper will lead us naturally to a conjecture on the proximinality of the subspaces 
IZb(X) and 1Z C (X) in the spaces B(X) and C(X) respectively. 

At the end of this section, we want to draw the readers attention to the more 
general case in which the number of directions is more than two. In this case, the 
set of approximating functions is 

ft(a\...,a r ) = j^ft (a 4 -x) : 9i : R -f R, i = 1, rj . 

In a similar way as above, one can define the sets 1Z a (X), IZb(X) and 1Z C (X). 
Using the results of [7] , one can obtain sufficient (but not necessary) conditions for 
proximinality of these sets. This needs, besides paths (see Sectionl), the consid- 
eration of some additional and more complicated relations between points of X. 
The case r > 3 will not be considered in the current paper, since our main purpose 
is to draw readers' attention to the arisen problems of proximinality in the sim- 
plest case of approximation. For the existing open problems connected with the set 
ft(a 1 ,...,a r ), where r > 3, see [13] and [23]. 

1. Proximinality of TZb(X) in B(X) 

We begin this section with the definition of a path with respect to two different 
directions a 1 and a 2 . A path with respect to the directions a 1 and a 2 is a finite 
or infinite ordered set of points (x^x 2 ,...) in R" with the units x 4+1 — x 4 , i = 



ON THE PROXIMINALITY OF RIDGE FUNCTIONS 



3 



1,2,..., in the directions perpendicular alternatively to a 1 and a 2 . In the sequel, 
we simply use the term "path" instead of the long expression "path with respect 
to the directions a 1 and a 2 ". The length of a path is the number of its points 
and can be equal to oo if the path is infinite. A singleton is a path of the unit 
length. We say that a path (x 1 , ...,x m ) belonging to some subset X of M™ is 
irreducible if there is not another path (y 1 , ...,y') C X with y 1 = x 1 , y l = x m and 

1 < m. If in a path (x 1 , ...,x m ) m is an even number and the set (x 1 , ...,x m ,x 1 ) 
is also a path, then the path (x 1 , ...,x m ) is called to be closed. The notion of a 
path in the case when the directions a 1 and a 2 are basis vectors in K 2 was first 
introduced by Diliberto and Straus [6] and exploited further in a number of works 
devoted to the approximation of bivariate functions by univariate functions (see, 
for example, [1,8,10,14,21]). Braess and Pinkus [2] used the notion in their solution 
to one problem of interpolation by ridge functions. It also appeared in problems 
of representation and well approximation of a continuous multivariate function by 
functions in 1Z C (X) (sec [13]). 

The following theorem follows from theorem 2 of [7]: 

Theorem 1.1. Let X C M™ and the lengths of all irreducible paths in X be 
uniformly bounded by some positive integer. Then each function in B{X) has an 
extremal element in IZb(X). 

There are a large number of sets in K" satisfying the hypothesis of this theorem. 
For example, if a set X has a cross section according to one of the directions a 1 or a 2 , 
then the set X satisfies the hypothesis of theorem 1.1. By a cross section according 
to the direction a 1 we mean any set X & i = {x 6 X : a 1 • x = c}, c G R, with the 
property: for any y £ X there exists a point y 1 6 X a i such that a 2 • y = a 2 • y 1 . 
By the similar way, one can define a cross section according to the direction a 2 . 
Regarding theorem 1.1, one may ask if the condition of the theorem is necessary 
for proximinality of IZb(X) in B{X). While we do not know a complete answer to 
this question, we are going to give an example of a set X for which theorem 1.1 
fails. Let a 1 = (1; -1), a 2 = (1; 1). Consider the set 

X = {(2; |), (|; -|), (0; 0), (1; 1), (1 + I; 1 - I), (1 + I + i ; 1 - I + I), 

, 1 1 1 1 1 1. 
(1+ 2 + 4 + 8 ;1 -2 + 4-8 ) - } - 

In what follows, the elements of X in the given order will be denoted by x°, x 1 , x 2 , ... 
. It is clear that X is a path of the infinite length and x™ — > x° , as n — > oo. Let 
J2^=i c n be any divergent series with the terms c„ > and c„ — > 0, as n — > 
oo. Besides let /o be a function vanishing at the points x°, x 2 , x 4 , and taking 
values ci,c 2 ,c 3 ,... at the points x^x^x 5 ,... respectively. It is obvious that f is 
continuous on X. The set X is compact and satisfies all the conditions of proposition 

2 of [21]. By this proposition, 1Z C (X) = C(X). Therefore, for any continuous 
function on X, thus for / , 

J&oM-rton~°- (L1) 

Since 1Z C (X) C IZb(X), we obtain from (1.1) that 



(1.2) 
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Suppose that fo has an extremal element g® (a^x) + g® ( a2 ' x ) m T^-b(X). By 
the definition of IZb(X), the ridge functions g®,i = 1,2, are bounded on X. From 
(1.2) it follows that f = g\ (a x -x) + g% (a 2 -x) . Since a 1 • x 2 ™ = a 1 • x 2n+1 and 
a 2 • x 2ll+1 = a 2 • x 2 ™+ 2 , for n = 0, 1, we can write 

£^i = E[/(* aB+1 )-/(* aB )] 

n=0 n=0 

= 2 [.9 2 °(x 2 " +1 ) - 5 2 °(x 2 ")] = ff2 °(a 2 • x 2 ** 1 ) - ff2 °(a 2 ■ x°). (1.3) 

n=0 

Since Y^=i c n = °°j we deduce from (1.3) that the function g® (a 2 -x) is not 
bounded on X. This contradiction means that the function /o does not have an 
extremal element in IZb(X). Therefore, the space IZb(X) is not proximinal in B(X). 

Remark. The above example is a slight generalization and an adaptation of 
Havinson's example (see [10]) to our case. 

2. Proximinality of 1Z c (X) in C(X) 

In this section, we are going to give sufficient conditions and also a necessary 
condition for proximinality of 1Z C (X) in C(X). 

Theorem 2.1. Let the system of independent vectors a 1 and a 2 has a comple- 
ment to a basis {a 1 , a™} in R" with the property: for any point x° e X and any 
positive real number 5 there exist a number 5q G (0, 5} and a point x CT in the set 

a = {x G X : a 2 • x° - S < a 2 • x < a 2 • x° + 5 }, 
such that the system 

( a 2 • x' = a 2 • x CT 

<^ a 1 -x' = a 1 -x (2.1) 

I Er = 3|a 4 -x'-a«.x| <S 
has a solution x' G a for all points x e a. Then the space 1Z C (X) is proximinal in 
C(X). 

Proof. Introduce the following mappings and sets: 

TTi : X — > M, 7Tj(x) — & ■ x, Yi = TTi(X), i = 1, n. 

Since the system of vectors {a 1 ,..., a"} is linearly independent, the mapping 
7T = (m, ...7r„) is an injection from X into the Cartesian product Y\ x ... x Y n . 
Besides, 7r is linear and continuous. By the open mapping theorem, the inverse 
mapping 7r _1 is continuous from Y = ir(X) onto X. Let / be a continuous function 
on X. Then the composition / o 7r _1 (j/i, ...y n ) will be continuous on Y, where 
yi = 7Ti(x), i = 1, ...,n, are the coordinate functions. Consider the approximation 
of the function / o ir^ 1 by elements from 

Go = {gi(yi) + .9 2 (y 2 ) : g> e C(r 4 ), * = 1,2} 

over the compact set Y. Then one may observe that the function / has an extremal 
element in 1Z C (X) if and only if the function /o7r _1 has an extremal element in Go- 
Thus the problem of proximinality of 1Z C (X) in C{X) is reduced to the problem of 
proximinality of Go in C(Y). 
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Let T, Ti, T m +i be metric compact spaces and T C Ti x ... x T m +\. For 
i = 1, m, let ipi be the continuous mappings from T onto T,. In [7], the authors 
obtained sufficient conditions for proximinality of the set 

n 

C = (^9i °(fii- 9i G C(Ti), i = 1, ...m} 

i=l 

in the space C(T) of continuous functions on T. Since Y C Y\ x Y2 x Z3, where 
Z$ = Ys x ... x y„, we can use this result in our case for the approximation of the 
function / o n^ 1 by elements from Go- By this theorem, the set Go -is proximinal 
in C(Y) if for any 2/2 G Y2 and S > there exists a number So G (0, 6) such that 
the set <t(j/2, ^0) = [2/2 ~ ^0, 2/2 + ^0] H I2 has (2, 5) maximal cross section. The last 
means that there exists a point y% G (7(2/2, #o) wl th the property: for any point 
(2/1,2/2,^3) G Y, with the second coordinate 2/2 from the set (7(2/2, #o), there exists 
a point (2/1, 2/2 , £3) G y such that 2/1 = 2/1 and ,0(2:3,23) < 5, where p is a metrics 
in Z 3 . Since these conditions are equivalent to the conditions of theorem 2.1, the 
space Go is proximinal in the space C(Y). Then by the above conclusion, the space 
1Z C (X) is proximinal in C(X). □ 

Let us give some simple examples of compact sets satisfying the hypothesis of 
theorem 2.1. For the sake of brevity, we restrict ourselves to the case n — 3. 

(a) Let X be a closed ball in R 3 , a 1 and a 2 be two arbitrary orthogonal direc- 
tions. Then theorem 2.1 holds. Note that in this case, we can take So = S 
and a 3 as an orthogonal vector to both the vectors a 1 and a 2 . 

(b) Let X be the unite cube, a 1 = (1;1;0), a 2 = (1;— 1;0). Then theorem 
2.1 also holds. In this case, we can take 5q = S and a 3 = (0;0; 1). Note 
that the unit cube does not satisfy the hypothesis of the theorem for many 
directions (take, for example, a 1 = (1; 2;0) and a 2 = (2; — 1; 0)). 

In the following example, one can not always chose So as equal to S. 

(c) Let X = {(xi, X2, X3) : (x\,X2) G Q, < X3 < 1}, where Q is the union 
of two triangles A\B\C\ and A2B2C2 with the vertices A\ = (0;0), B\ = 
(1;2), Ci = (2;0), A 2 - (1±;1), B 2 = (2|;-1), G 2 = (3|;1). Let a 1 = 
(0; 1; 0) and a 2 = (1; 0; 0). Then it is easy to see that theorem 2.1 holds (the 
vector a 3 can be chosen as (0; 0; 1)). In this case, So can not be always chosen 
as equal to S. Take, for example, x° = (l|; 0; 0) and S = l|. If So — S, then 
the second equation of the system (2.1) has not a solution for a point (1; 2; 0) 
or a point (2|; —1; 0). But if we take So not more than j, then for x CT = x° 
the system has a solution. Note that the last inequality |a 3 • x' — a 3 • x| < S 
of the system can be satisfied with the equality a 3 -x' = a 3 x if a 3 = (0; 0; 1). 

It should be remarked that the results of [7] tell nothing about necessary condi- 
tions for proximinality of the spaces considered there. To fill this gap in our case, 
we want to give a necessary condition for proximinality of 1Z C (X) in C(X). Our 
result will be based on the result of Marshall and O'Farrell given below. First, let us 
introduce some notation. By TV C , i = 1, 2, we will denote the set of continuous ridge 
functions g (a 1 • x) on the given compact set X C M™. Note that TZ C = 1Z\ + 1Z 2 . 
Besides, let 1Z 3 = H\ fl 1Z 2 . For i = 1,2,3, let Xi be the quotient space obtained 
by identifying points 2/1 and 2/2 in X whenever f(yi) — f{y2) for each / in TZ l c . 
By TTi denote the natural projection of X onto Xi, i = 1,2, 3. Note that we have 
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already dealt with the quotient spaces X\, X2 and the projections 7Ti, tt2 in the pre- 
vious section (see the proof of theorem 2.1). The relation on X, defined by setting 
Vi ~ V2 if yi and yi belong to some path, is an equivalence relation. According to 
Marshall and O'Farrell [21] the equivalence classes we call orbits. By 0(t) denote 
the orbit of X containing t. For Y C X, let vary / be the variation of a function 
/ on the set Y. That is, 

varf = sup \f{x)-f(y)\. 

Y x.yeY 

Theorem 2.2. Suppose that the space 1Z C (X) is proximinal in C{X).Then there 
exists a positive real number c such that 

sup varf < c sup var f (2.2) 

teXO(t) teX TV' 1 (7T 2 (t)) 

for all f inlZ\. 

The proof is simple. In [21], Marshall and O'Farrell proved the following result 
(see Proposition 4 in [21]): Let A\ and A 2 be closed subalgebras of C(X) that 
contain the constants. Let (Xi,7Ti), (X 2 ,7r 2 ) and (X 3 ,7r 3 ) be the quotient spaces 
and projections associated with the algebras A\, Ai and A3 = A± n A2 respectively. 
Then A\ + A2 is closed in C(X) if and only if there exists a positive real number c 
such that 

sup var f < c sup var f (2-3) 

zeX 3 TT3 1 (z) yeX 2 7T- 1 (y) 

for all / in A\. 

If 1Z C (X) is proximinal in C(X), then it is necessarily closed and therefore, by 
the above proposition, (2.3) holds for the algebras A\ = TZ l c , i = 1,2, 3. The right- 
hand side of (2.3) is equal to the right-hand side of (2.2). Let t be some point in X 
and z = TTs(t). Since each function / G V? c is constant on the orbit of t (note that 
/ is both of the form gi (a^x) and of the form g 2 (a 2 -x)), 0{t) C n^ 1 (z). Hence, 

sup varf < c sup var f (2.4) 

texO(t) zex 3 it- 1 (z) 

From (2.3) and (2.4) we obtain (2.2). 

Note that the inequality (2.3) provides not worse but less practicable necessary 
condition for proximinality than the inequality (2.2) does. On the other hand, there 
are many cases in which both the inequalities are equivalent. For example, let the 
lengths of irreducible paths of X are bounded by some positive integer no- In this 
case, it can be shown that the inequality (2.3), hence (2.2), holds with the constant 
c = ^ and moreover 0(t) = 7r 3 _1 (z) for all t E X, where z = ir 3 (t) (see the proof 
of theorem 5 in [13]). Therefore, the inequalities (2.2) and (2.3) are equivalent for 
the considered class of sets X. The last argument shows that all the compact sets 
X C M™ over which 1Z C (X) is not proximinal in C(X) should be sought in the class 
of sets having irreducible paths consisting sufficiently large number of points. For 
example, let I = [0; l] 2 be the unit square, a 1 — (1; 1), a 2 = (1; |). Consider the 
path 

? fe = {(l;0),(0;l),(i;0),(0;i),(i;0),...,(0;l)}. 
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It is clear that Ik is an irreducible path with the length 2k + 2, where k may 
be very large. Let gu be a continuous univariate function on R satisfying the 
conditions: gti^^r) — i, i — 7 ...,k, gk{t) = if t < i — 1 < <7fc(t) < i if 
i G ( 2fc J i+ i , 2^1)1 * — 1; •■•! an( i fffe(i) = if t > 1. Then it can be easily verified 
that 

sup var fffc(a -x) < 1. (2.5) 

Since max xe /5 fe (a 1 -x) = fc, min xe /5 fe (a 1 -x) = and t>ar xe0 ( tl )5 fe (a 1 -x) = fc for 
t\ = (1; 0), we obtain that 

sup war gfe (a 1 -x) = fc. (2.6) 

texO(t) 

Since k may be very large, from (2.5) and (2.6) it follows that the inequality 
(2.2) cannot hold for the function (^(a^x) G Thus the space TZ C (I) with the 
directions a 1 = (1; 1) and a 2 = (1; 5) is not proximinal in C(i"). 

It should be remarked that if a compact set X C R™ satisfies the hypothesis of 
theorem 2.1, then the length of all irreducible paths are uniformly bounded (see 
the proof of theorem 2.1 and lemma in [7]). We have already seen that if the 
last condition docs not hold, then the proximinality of both 1Z C (X) in C{X) and 
IZb(X) in B{X) fail for some sets X. Besides the examples given above and in 
Section 1, one can easily construct many other examples of such sets. All these 
examples, theorems 1.1, 2.1, 2.2 and the following remarks justify the statement of 
the following conjecture: 

Conjecture. Let X be some subset o/R™. The space IZb(X) is proximinal in 
B{X) and the space 1Z C (X) is proximinal in C{X) (in this case, X is considered 
to be compact) if and only if the lengths of all irreducible paths of X are uniformly 
bounded. 

Remark 1. After completion of this work, Medvedev's result came to our atten- 
tion (see [16, p.58]). His result, in particular, states that the set R C {X) is closed in 
C{X) if and only if the lengths of all irreducible paths of X are uniformly bounded. 
Thus, in the case of C(X), the necessity of the above conjecture was proved by 
Medvedev. 

Remark 2. Note that there are situations in which a continuous function (a 
specially chosen function on a specially constructed set) has an extremal element 
in IZb(X), but not in 1Z C (X) (see [16, p. 73]). One subsection of [16] (see p. 68) 
devoted to the proximinality of sums of two univariate functions with continuous 
and bounded summands in the spaces of continuous and bounded bivariate func- 
tions respectively. If X C R 2 and a 1 , a 2 be linearly independent directions in R 2 , 
then the linear transformation j/i = a 1 • x , j/2 = a 2 • x reduces the problems of 
proximinality of IZb(X) in B{X) and 1Z C (X) in C(X) to the problems considered in 
that subsection. But in general, when X C R", n > 2, our case cannot be obtained 
from that of [16]. 
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